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(54) Adaptive video signal compression 

(57) This invention relates to improvements in com- 
pressing digital signals, particularly in buffer manage- 
ment-prior to transmission. 

This invention provides a method of compressing 
an input digital signal 1 0 to produce an output digital sig- 
nal 1 3 in a system having a buffer 1 2. The degree of 
compression is variable and is controlled according to 
the occupancy of the buffer 12. The output signal 13 
contains a representation of the applied compression 
within a predetermined range having an upper limit. The 



input signal may be compressed beyond the upper limit 
according to the occupancy of the buffer 12 whilst con- 
tinuing to include a representation of the applied com- 
pression in the output signal that is within the predeter- 
mined range. One advantage of this method is that the 
encoder 20 can sustain rapid changes in bit-rate and 
avoid encoder buffer overflow and hence decoder buffer 
underflow. 

The invention provides a method and apparatus for 
improving the management of data within the encoder 
20 and consequently the decoder 16. 
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Description 

This invention relates to improvements in com- 
pressing digital signals, particularly in buffer manage- 
ment prior to transmission. 

In the field of digital transmission of data, including 
broadcasting, it is desirable to compress the data prior 
to transmission in order to reduce the required band- 
width. Standardising the characteristics of the com- 
pressed signal means that the transmitted signal can be 
received and decompressed by all users in a known 
manner. One such standard is ISO/IEC 13818, also 
known as MPEG-2. 

A video signal is compressed by removing any spa- 
tial or temporal redundancy in the signal, i.e. eliminating 
any predictability in the source signal. The predictability 
of a video signal is highly dependent on the image con- 
tent and so the bit-rate of the compressed signal varies 
according to the criticality of the image. Criticality is an 
indication of how difficult an image is to compress. 

The compression takes place in an encoder where- 
in the compressed signal is" passed to a buffer prior to 
transmission. This buffer is used to accommodate a cer- 
tain amount of bit-rate variation of the compressed sig- 
nal. The transmitted video signal is received and sub- 
sequently passed to a decoder which also contains a 
buffer to store the compressed signal prior to decom- 
pression. 

The MPEG-2 standard defines a number of subsets 
of the syntax and semantics which also define the de- 
coder capabilities required to decode a particular bit- 
stream. A profile is a defined sub-set of the entire bit- 
stream syntax that is defined by this MPEG-2 specifica- 
tion. A level is a defined set of constraints imposed on 
parameters in the bit-stream. 

Vital to the delivery of uninterrupted decoded video 
is the prevention of decoder buffer overflow or under- 
flow. MPEG-2 Main Profile at Main Level <MP@ML) de- 
fines a decoder buffer size of 1 .8 Mb its, and typically an 
encoder design will include an encoder buffer of at least 
the same size. The two buffers form a complementary 
pair where the total amount of data contained remains 
constant. This arrangement allows the decoder buffer 
occupancy to be determined from the encoder buffer 
and the maintenance of the decoder buffer occupancy 
can be achieved by ensuring the encoder buffer occu- 
pancy remains within the 1.8 Mbit range. 

One method for keeping the encoder buffer occu- 
pancy within predetermined limits, involves deriving a 
Quantisation parameter (Qp) from the buffer occupancy. 
Qp controls the amount of quantisation applied to the 
video signal and hence varies the compression. In broad 
terms, the higher the encoder buffer occupancy, the 
higher the Qp applied. This has the effect of limiting the 
input bit-rate into the buffer allowing the buffer occupan- 
cy to decrease. In order to correctly decompress the re- 
ceived signal, the decoder must know the level of quan- 
tisation applied at the encoder. To achieve this, Qp is 



inserted into the signal and subsequently used by the 
decoder. The MPEG-2 standard defines the maximum 
allowable value of Qp that can be sent to a decoder as 
31. 

5 This method performs well under most conditions. 

However, where a significant mismatch exists between 
the output bit-rate from the encoder buffer and the input 
bit-rate required to compress a critical video signal, the 
maximum allowable quantisation may be insufficient to 

10 adequately reduce the data rate produced by the com- 
pression process. This may lead to encoder buffer over- 
flow and hence decoder buffer underflow. 

Accordingly, one object of the present invention is 
to provide a method and apparatus for improving the 

is management of data within the encoder and decoder 
buffers. 

According to one aspect of the present invention, 
there is provided a method of compressing an input dig- 
ital signal to produce a compressed output digital signal 

20 in which the degree of compression is variable and is 
represented in the output signal within a predetermined 
range having an upper limit, and compressing the input 
signal beyond the upper limit whilst representing in the 
output signal that the degree of compression is within 

25 the predetermined range. 

According to a second aspect of the present inven- 
tion, there is provided a method of compressing an input 
digital signal to produce a compressed output digital sig- 
nal, the method comprising the steps of: applying the 

30 input digital signal to a compressor for compressing the 
input signal; passing the result of compression by the 
compressor through a buffer to form said output signal; 
changing the degree of compression applied by the 
compressor according to the occupancy of the buffer to 

35 control the data flow rate through the buffer;' including 
in the output digital signal a representation of the degree 
of compression applied by the compressor within a pre- 
determined range having an upper limit; and causing the 
compressor to compress the input signal beyond the up- 

40 per limit when the occupancy of the buffer has reached 
a predetermined level whilst continuing to include in the 
output signal a representation that the degree of com- 
pression is within the predetermined range. 

According to a third aspect of the present invention, 

45 there is provided apparatus for compressing an input 
digital signal to produce a compressed output digital sig- 
nal, the apparatus comprising a compressor to com- 
press the input signal to a degree of compression that 
is variable and is represented in the output digital signal 

50 within a predetermined range having an upper limit, and 
a controller to control the compressor to compress the 
input signal beyond the upper limit while representing in 
the output signal that the degree of compression is with- 
in the predetermined range. 

55 According to a fourth aspect of the present inven- 
tion, there is provided apparatus for compressing an in- 
put digital signal to produce a compressed output digital 
signal, the apparatus comprising: a compressor for 
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compressing the input digital signal; a controller to 
change the degree of compression applied by the com- 
pressor according to the occupancy of a buffer to control 
the data flow through the buffer and to include in the 
output signal a representation of the degree of compres- 
sion applied by the compressor within a predetermined 
range having an upper limit; and the controller being 
adapted to control the compressor to compress the input 
signal beyond the upper limit when the occupancy of the 
buffer has reached a predetermined level while contin- 
uing to include in the output signal a representation that 
the degree of compression is within the predetermined 
range. 

Reference will now be made, by way of example, to 
the accompanying drawings, in which: 

Figure 1 is a schematic diagram of a broadcasting 
system according to the present invention; and 

Figure 2 is a diagram showing an encoder included 
in the broadcasting system of Figure 1 . 

A broadcast system is illustrated in Figure 1 and in- 
cludes an encoder 20 and a decoder 1 6. An input signal 
10, such as a video signal is fed to the encoder 20 com- 
prising a compressor 1 1 and a buffer 1 2. The video sig- 
nal 10 is compressed by compressor 11 and passed 
through the buffer 1 2 to produce a compressed output 
digital signal 13. The compressed signal is then trans- 
mitted to a receiver 15 where it is subsequently input to 
a decoder 16 wherein the compressed signal is passed 
through a buffer 17 before entering the decompressor 
18 which produces an uncompressed video signal 19. 

In Figure 1, the transmission from the encoder 20 
to the decoder 16 is via a satellite 14, although other 
means of transmission could also be used such as a 
cable, terrestrial or data broadcasting network. The buff- 
er 12 in the encoder 20 is required to accommodate the 
bit-rate variation caused by the compression process 
and the decoder buffer 17 stores the received com- 
pressed data until it is required by the decompressor 18. 

An MPEG-2 decoder buffer at Main Profile at Main 
Level (MP@ML) is limited to 1 .8 Mbits. The encoder and 
decoder buffers, 1 2 and 1 7 respectively, form a comple- 
mentary pair where the total amount of data contained 
remains constant. The maintenance of the decoder buff- 
er occupancy can therefore be achieved by ensuring the 
encoder buffer occupancy remains within the 1 .8 Mbit 
range. 

Figure 2 shows a simplified block diagram of an ex- 
ample implementation of the proposed method to im- 
prove the management of data in the encoder, in partic- 
ular to avoid buffer overflow. The video input signal 10 
is fed via a subtractor to a forward DCT block 21 . After 
DCT transformation, the signal is split into two paths: 
the DC coefficients and the AC coefficients. The DC co- 
efficients are fed directly to a DC variable length coder 
25 and to an inverse DCT block 27. The AC coefficients 



are fed to a quantiser 22 before being fed to an AC var- 
iable length coder 23 and to an inverse quantiser 26. 
After inverse quantisation, the AC coefficients are com- 
bined with the DC coefficients in the inverse DCT block 

s to generate a reconstructed image for use in the motion 
compensator 28 and motion estimator 29. The motion 
compensator 28 passes a motion compensated image 
to the subtractor to aid in the temporal compression of 
subsequent images. The motion estimator 29 generates 

10 motion vectors which are passed to the motion vector 
variable length coder 30. The outputs of the DC, AC and 
motion vector variable length coders, 25, 23 and 30 re- 
spectively, are merged to form the input of the encoder 
buffer 12. 

15 One method for maintaining the encoder buffer oc- 
cupancy within limits, derives the Quantisation param- 
eter (Qp) in the controller 24 from the buffer occupancy. 
This value of Qp is used to control the quantiser 22, and 
is inserted into the compressed output signal 1 3 for sub- 

20 sequent use at the decoder. In MPEG-2 the maximum 
allowable value of Qp in the decoder is 31 . However, it 
is sometimes the case that this value is insufficient in 
the encoder to avoid buffer overflow. 

It is important that an MPEG compliant data-stream 

25 js maintained at all times. Failure to do this will result in 
a breakdown in the decoding process and lead to picture 
degradation or even complete picture loss. Allowing 
buffer overflow or underflow results in a data-stream 
which is not MPEG compliant. 

30 This invention is concerned with preventing the oc- 
currence of this rate control problem and therefore en- 
suring that the data-stream produced is always com- 
pletely MPEG compliant. The controller 24 detects when 
the output buffer 12 is approaching overflow. The con- 

35 troller generates a value of Qp that exceeds the maxi- 
mum allowable limit and applies this to the quantiser 22. 
This further reduces the data rate by quantising to zero 
more DCT AC coefficients beyond that which would oth- : 
erwise have been possible. This value of Qp, although 

40 not part of the MPEG-2 specification, is restricted to the- 
encoder and is represented in the output signal 13 within 
a predetermined range having an upper limit. Compli- 
ance to the MPEG-2 standard is achieved by represent- 
ing the maximum compliant value of Qp in the output 

45 signal 13. Furthermore, this compliant value of Qp is 
used in the inverse quantiser 26. This ensures that the 
motion compensation is based on the DCT coefficients 
produced by the decoder. 

The result of this 'over-quantising' has no real visual 

50 impact on a decoder. As the value of Qp reaches its up- 
per limit, the quantisation becomes noticeably coarse 
and will become visible to the viewer. The decoder is 
told that the 'over-quantised' signal was actually quan- 
tised at a lower level, and will therefore reverse quantise 

55 the signal according to the level indicated in the data- 
stream. The decoder will obviously not be able to faith- 
fully reverse quantise the 'over-quantised* signal, and 
this will result in further degradation of the image. How- 



3 



BEST AVAILABLE COPY 



5 



EP 0 868 084 A1 



6 



ever, the visual effect of this is unlikely to be more no* 
ticeable than an already heavily quantised picture. 

The present invention has particular application in 
dealing with extreme situations which would normally 
result in buffer overflow and a non-MPEG compliant 
stream. In these extreme situations picture degradation 
is not a major concern, although keeping the data- 
stream MPEG compliant is of utmost importance. 

In extreme circumstances the previous method may 
still prove inadequate in reducing the data flow into the 
output buffer 12. This situation is detected by the con- 
troller 24 which forces all the AC coefficients to zero in 
the quantiser 22. 

Using the proposed methods of buffer manage- 
ment, the encoder can react to rapid changes in the im- 
age criticality and avoid encoder buffer overflow. 



Claims 

1. A method of compressing an input digital signal to 
produce a compressed output digital signal in which 
the degree of compression is variable and is repre- 
sented in the output signal within a predetermined 
range having an upper limit, and compressing the 
input signal beyond the upper limit whilst represent- 
ing in the output signal that the degree of compres- 
sion is within the predetermined range. 

2. A method as claimed in claim 1 , including the further 
step of buffering the compressed signal by use of a 
buffer, and controlling the degree of compression to 
control the occupancy of the buffer. 

3. A method as claimed in claim 1 or claim 2, wherein 
the compression of the input digital signal includes 
quantising coefficients of the input digital signal. 

4. A method as claimed in claim 3 which is applied to 
compressing an input digital signal which is a digital 
video signal and said coefficients are discrete co- 
sine transform coefficients. 

5. A method as claimed in claim 4 including forcing 
said coefficients to a zero value to contain the data 
rate of the compressed signal within the capacity of 
the buffer. 

6. A method of compressing an input digital signal to 
produce a compressed output digital signal, the 
method comprising the steps of: 

applying the input digital signal to a compressor 
for compressing the input signal; 
passing the result of compression by the com- 
pressor through a buffer to form said output sig- 
nal; 

changing the degree of compression applied by 



the compressor according to the occupancy of 
the buffer to control the data flow rate through 
the buffer; 

including in the output digital signal a represen- 
5 tation of the degree of compression applied by 

the compressor within a predetermined range 
having an upper limit; and 
causing the compressor to compress the input 
signal beyond the upper limit when the occu- 
rs pancy of the buffer has reached a predeter- 
mined level whilst continuing to include in the 
output signal a representation that the degree 
of compression is within the predetermined 
range. 

15 

7. Apparatus for compressing an input digital signal to 
produce a compressed output digital signal, the ap- 
paratus comprising a compressor to compress the 
input signal to a degree of compression that is var- 

20 iable and is represented in the output digital signal 
within a predetermined range having an upper limit, 
and a controller to control the compressor to com- 
press the input signal beyond the upper limit while 
representing in the output signal that the degree of 

25 compression is within the predetermined range. 

8. Apparatus as claimed in claim 7, including a buffer 
to buffer the compressed signal, the controller being 
adapted to control the degree of compression to 

30 control the occupancy of the buffer. 

9. Apparatus as claimed in claim 7 or claim 8, wherein 
the compressor is adapted to compress by quan- 
tising coefficients of the input digital signal. 

35 

10. Apparatus as claimed in claim 9, wherein the com- 
pressor is adapted to compress an input digital sig- 
nal which is a digital video signal and is adapted to 
quantise discrete cosine transform coefficients of 

40 the video signal. 

11. Apparatus as claimed in claim 1 0, wherein the con- 
troller is adapted to force said coefficients to zero 
to contain the data rate of the compressed signal 

45 within said buffer means. 

12. Apparatus for compressing an input digital signal to 
produce a compressed output digital signal, the ap- 
paratus comprising: 

so 

a compressor for compressing the input digital 
signal; 

a controller to change the degree of compres- 
sion applied by the compressor according to 
ss the occupancy of a buffer to control the data 

flow through the buffer and to include in the out- 
put signal a representation of the degree of 
compression applied by the compressor within 
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a predetermined range having an upper limit; 
and 

the controller being adapted to control the com- 
pressor to compress the input signal beyond 
the upper limit when the occupancy of the buffer s 
has reached a predetermined level while con- 
tinuing to include in the output signal a repre- 
sentation that the degree of compression is 
within the predetermined range. 

70 

13. A method of transmitting a signal compressed ac- 
cording to the method of any of claims 1 to 6, com- 
prising the further step of reverse quantising the sig- 
nal at a decoder according to the level of compres- 
sion represented in the compressed digital signal. '5 



14. A method of compressing an input digital signal to 
produce a compressed output digital signal, the 
method substantially as herein described with ref- 
erence to Figure 2. 20 



15. Apparatus for compressing an input digital signal to 
produce a compressed output digital signal, the ap- 
paratus substantially as herein described and illus- 
trated in Figure 2. 25 
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